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EXECUTIVE SUMMARY 






The Office of Research and Planning provided the first comprehensive analysis of grades at 
Nova Southeastern University in 1996. Because of the way data were organized, it was not 
possible at that time to report grades based on place of class instruction (on-campus and off- 
campus). 

Since then, Research and Planning has conducted analyses of grades by faculty affiliation 
status (full-time faculty and part-time faculty) and by place of class instruction (on-campus 
courses and off-campus courses). These analyses focused on courses taught during Winter 
Term 1997, with breakouts provided for each academic center. 

The purpose of this report is to build on these studies and to report on grades by place of 
class instruction for selected courses in the Fischler Graduate School of Education and 
Human Services. Specifically, this report focused on key courses in the School’s four 
programs that offer both on-campus instruction and off-campus instruction: 

■ Ed.D. Program for Educational Leaders 
EDL 8121 Evaluation 

■ Programs in Education and Technology 
RES 8433 Research and Evaluation II 

■ Programs for Higher Education 

ECD 8003 Curriculum and Program Planning 

■ Graduate Teacher Education Program 

EL 0600 Seminar in the Knowledge Base of Educational Leadership 

Administrative staff in the Fischler Graduate School of Education selected these courses for 
analysis since they are broadly-representative core courses that were offered to both on- 
campus students and off-campus students during Winter Term 1997. 

Following guidelines established by the Southern Association of Colleges and Schools: 

■ All courses offered in either Broward County or Miami-Dade County- were 
considered on-campus courses. 

■ All courses offered at other locations were considered off-campus courses. 
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This level of analysis should further support the University’s many efforts to assess the 
comparability of campus-based courses to courses offered at distance education sites. 

For all four courses, off-campus students were in parity with on-campus students in terms of 
the relative frequency of successful grades received. There were no instances where on- 
campus students received at a significant level (p < .05) a greater frequency of successful 
grades than off-campus students. 

Using the frequency of successful grades as a unit of measure, this study provides a degree 
of evidence that off-campus students enjoy academic success that certainly meets the level of 
academic success experienced by on-campus students. To gain a better sense of academic 
achievement between on-campus students and off-campus students, this study offered the 
recommendation that the Fischler Graduate School of Education and Human Services should 
provide some type of common assessment (possibly a common final examination) in selected 
courses that are offered in both formats. Then, it would be possible to empirically determine 
achievement of on-campus students and off-campus students on an equivalent examination or 
other common assessment instrument. 
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BACKGROUND 



The Office of Research and Planning provided the first comprehensive analysis of grades at 
Nova Southeastern University in 1996 {Grades at Nova Southeastern University: Fall Term 
1993, Fall Term 1994, and Fall Term 1995\ 1996). A limitation of that report was that 
grades could only be reported by academic center and not by place of class instruction (on- 
campus and off-campus). Since then, Research and Planning has reported on grades by 
faculty affiliation status (A Comparison of Final Grades Awarded by Full-Time Faculty and 
Part-Time Faculty by Academic Center for Winter Term 1997\ 1998) and by place of class 
attendance (A Comparison of Final Grades Awarded in Campus-Based Courses and Courses 
Offered Through Distance Education for Winter Term 1997\ 1998). 

The purpose of this report is to build on these studies and to report on grades by place of 
class instruction for selected courses in the Fischler Graduate School of Education and 
Human Services. Specifically, this report focused on key courses in the School’s four 
programs that offer both on-campus instruction and off-campus instruction: 

■ Ed.D. Program for Educational Leaders 
EDL 8121 Evaluation 

■ Programs in Education and Technology 
RES 8433 Research and Evaluation II 

■ Programs for Higher Education 

ECD 8003 Curriculum and Program Planning 

■ Graduate Teacher Education Program 

EL 0600 Seminar in the Knowledge Base of Educational Leadership 

Administrative staff in the Fischler Graduate School of Education selected these courses for 
analysis since they are broadly-representative core courses that were offered to both on- 
campus students and off-campus students during Winter Term 1997. 

Guidelines established by the Southern Association of Colleges and Schools were used to 
provide an operational definition of on-campus instruction and off-campus instruction: 

■ All courses offered in either Broward County or Miami-Dade County were 
considered on-campus courses. 
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During Winter Term 1997, 68.1 percent of all grades in the Fischler Graduate 
School of Education and Human Services were awarded in on-campus classes. 

All courses offered at other locations were considered off-campus courses. 

During Winter Term 1997, 31.9 percent of all grades in the Fischler Graduate 
School of Education and Human Services were awarded in off-campus classes. 



METHODOLOGY 



The methodology used for Grades at Nova Southeastern University: Fall Term 1993, Fall 
Term 1994, and Fall Term 1995 (1996) was quite useful and the methodology for this report 
largely replicates the procedures used in that prior study; 

1. The computing center provided the original extract file on November 11, 1997. 

This date provided an approximate four month interim from the end of Winter Term 
1997 and the creation of the extract file, allowing sufficient time for adjustment to 
most Incomplete grades and the posting of any late grades. 

2. The extract file was purposely prepared so that the five column cluster code for each 
course was identified, allowing for later discrimination between on-campus courses 
and off-campus courses. 

3. Administrative staff in the Fischler Graduate School of Education and Human 
Services selected one broadly representative core course from each of the four 
programs that offer courses to both on-campus students and off-campus students. 

4. Grades were organized into two separate categories: 

■ Successful grades (A, B, C, and Pass) 

■ All other grades 

The chi-square test was then used to determine if there were differences in the frequency of 
successful grades awarded to on-campus students and off-campus students. 
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RESULTS 



Table 1 provides a degree of University-wide context to the frequency of successful grades 
and all other grades for on-campus students and off-campus students during Winter Term 
1997. Table 2 focuses exclusively on the Fischler Graduate School of Education and Human 
Services and the frequency of successful grades and all other grades for on-campus students 
and off-campus students during Winter Term 1997. For the entire School, students enrolled 
in courses offered through distance education received a significantly greater frequency of 
successful grades than their campus-based counterparts. 

Tables 3. A to 3.D specifically relate to the four courses selected for this study. For all four 
courses selected for this study, off-campus students were in parity with on-campus students 
in terms of the relative frequency of successful grades received. There were no instances 
where on-campus students received, at a significant level (p < .05), a greater frequency of 
successful grades than off-campus students. 



SUMMARY 



The University is compelled by the Southern Association of Colleges and Schools to 
demonstrate that "[ ] its distance learning programs are effective and comply with all 
applicable Criteria" {Criteria for Accreditation; 1998, p. 40). The Southern Association of 
Colleges and Schools has further compelled the University to "Provide documentation that all 
distance learning courses are comparable to the on-campus courses and that the goals for 
each off-campus site are clear and explicit and are assessed regularly" (personal 
communication from J. T. Rogers, July 2, 1998). 

This report, in parity with findings identified in A Comparison of Final Grades Awarded in 
Campus-Based Courses and Courses Offered Through Distance Education for Winter Term 
1997 (1998), provides a degree of evidence that officampus students enjoy academic success 
that certainly meets the level of academic success experienced by on-campus students. Using 
the frequency of successful grades as a unit of measure, the findings of this report provide 
ample evidence that "distance learning courses are comparable to the on-campus courses." 

To gain a better sense of academic achievement between on-campus students and off-campus 
students, this study offered the reconunendation that the Fischler Graduate School of 
Education and Human Services should provide some type of standardized assessment 
(possibly a conunon final examination) in selected courses that are offered in both formats. 
Then, it would be possible to empirically determine achievement of on-campus students and 
off-campus students on an equivalent examination or other common assessment instrument. 
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Summary of Winter Term 1997 Grades by Place of Class Location; Fischler Graduate School of Education 
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Summary of Winter Term 1997 Grades by Place of Class Location: ECD 8003 (Curriculum and Program Planning) 

Successful Grades 
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Table 4 



Comparison of Successful Grades During Winter Term 1997 for Three Courses 
Offered On-Campus and Off-Campus 



Course Chi-square p Significant difference at p ^ .05 



EDL 8121 


0.43 


.513 


No 


Off-Campus 


= On-Campus 


RES 8433 


n/a‘ 


n/a 


No 


Off-Campus 


= On-Campus 


ECD 8003 


1.04 


.307 


No 


Off-Campus 


= On-Campus 


EL 0600 


2.55 


.111 


No 


Off-Campus 


= On-Campus 



Chi-square can not be computed since there were zero observations for "All 
Other Grades" for both off-campus students and on-campus students. 
Accordingly, an inferential test is unnecessary for this analysis. All on- 
campus students received an "A, B, C, or Pass" and all off-campus students 
also received an "A, B, C, or Pass." 
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